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CONTROt SYSTEM AND METHOD FOR CONTROLLING 
AN ACTUATED PROSTHESIS 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application claims the benefits of U.S, provisional patent applications No. 
5 60/405,281 filed August 22, 2002; No. 60/424»261 filed November 6, 2002; and No. 
60/453,556 filed March 11. 2003, ail of which are hereby incorporated by reference, 

TECHNICAL FIELD 

The present invention relates to a control system and a method for controlling an 
actuated prosthesis. This invention is particularly wall adapted for controlling an 
1 0 actuated leg prosthesis for above*Knee amputees. 

BACKGROUND 

As is well Known to control engineers, the automation of complex mechanical systems 
is not something easy to achieve. Among such systems, conventional powered 
artificial limbs, or myoelectric prostheses, as they are more commonly referred to, are 

15 notorious for having control problems. These conventional prostheses are equipped 
with basic controllers that artificially mobilize the joints without any interaction from the 
amputee and are only capable of generating basic motions. Such basic controllers do 
not take into consideration the dynamic conditions of the working environment, 
regardless the fact that the prosthesis is required to generate appropriate control 

20 within a practical application. They are generally lacking in predictive control 
strategies necessary to anticipate the artificial limb*s response as well as lacking in 
adaptive regulation enabling the adjustment of the control parameters to the dynamics 
of the prosthesis. Because human limb mobility is a complex process including 
voluntary, reflex and random events at the same time, conventional myoel ctric 

25 prostheses do not have the capability to interact simultaneously with the human body 
and the external environment in ord r to have minimal appropriate functioning- 
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For exampl , in the case of artificial leg prostheses for above-knee amputees, the 
complexity of human locomotion resulted in that the technical Improvements of 
conventional leg prostheses have until now been focused on passive mechanisms. 
This proved to be truly detrimental to the integration of motorized leg prostheses onto 
5 the human body. According to amputees, specific conditions of use of conventional 
leg prostheses, such as repetitive movements and continuous loading, typically entail 
problems such as increases in metabolic energy expenditures, increases of socket 
pressure, limitations of locomotion speeds, discrepancies in the locomotion 
movements, disruptions of postural balance, disruptions of the pelvis-spinal column 
10 alignment, and increases in the use of postural clinical rehabilitation programs. 

The major problem remains that the energy used during mobility mainly stems from 
the user because conventional leg prostheses are not equipped with 
servomechanisms that enable self-propulsion. This energy compensation has 
considerable short and long-term negative effects resulting from the daily use of such 

15 prostheses. Accordingly, the dynamic role played by the stump during locomotion 
renders impossible the prolonged wearing of the prostheses as it may create, among 
other things, several skin problems such as folliculitis, contact dermatitis, edema, 
cysts, skin shearing, scarring and ulcers. Although these skin problems may b 
partially alleviated by using a silicon sheath, a complete suction socket, or powder, 

20 skin problems remain one of the major preoccupations today. 

As well, the passive nature of the conventional leg prostheses typically leads to 
movement instability, disrupted movement synchronism and reduced speed of 
locomotion. Recent developments in the field of energy-saving prosthetic 
components have partially contributed to improve energy transfer between th 
25 amputee and the prosthesis. Nevertheless, the problem of energy expenditure is still 
not fully resolved and remains the major concern. 

Considering this background, it clearly appears that there was a need to develop an 
improved control system and a new method for controlling an actuated prosthesis in 
ord r to fulfill the needs of amputees, in particular those of abov -knee amputees. 
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SUMMARY 

In accordance with one aspect of the present invention, there is provided a method for 
determining a portion of locomotion and a phase of locomotion portion in view of 
controlling an actuated prosthesis in real time, the method comprising: 

5 providing a plurality of main artificial proprioceptors: 

receiving a data signal from each of the main artificial proprioceptors; 

obtaining a first and a second derivative signal for each data signal; 

obtaining a third derivative signal for at least one of the data signals; 

using a set of a first state machines to select one state among a plurality of possible 
10 states for each main artificial proprioceptor with the corresponding data and derivative 
signals; 

generating the phase of locomotion portion using the states of the main artificial 
proprioceptors: and 

using a second state machine to select the portion of locomotion among a plurality of 
1 5 possible portions of locomotion using events associated to the data signals. 

In accordance with another aspect of the present invention, there is provided a 
method for controlling an actuated prosthesis in real time, the method comprising: 

providing a plurality of main artificial proprioceptors; 

receiving a data signal from each of the main artificial proprioceptors: 

20 obtaining a first and a second derivative signal for each data signal; 

obtaining a third derivative signal for at least one of the data signals; 

using a set of first state machin s to select one state among a plurality of possible 
states for each main artificial proprioceptor with the corresponding data and derivative 
signals; 
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generating the phase of locomotion portion using the states of the main artificial 
proprioceptors; 

using a second state machine to select the ponion of locomotion among a plurality of 
possible portions of locomotion using events associated to the data signals; 

5 calculating a locomotion speed value; 

detemiining coefficient values from a lookup table using at least the phase of 
locomotion portion, the portion of locomotion and the locomotion speed value; 

calculating at least one dynamic parameter value of the actuated prosthesis using the 
coefficient values irom the looKup table; and 

10 converting the dynamic parameter value into an output signal to control the actuated 
prosthesis. 

In accordance with a further aspect of the present invention, there is provided a 
device for determining a portion of locomotion and a phase of |oa)motion portion in 
view of controUing an actuated prosthesis in real time using a plurality of main artificial 
1 5 proprioceptors, the device comprising: 

a data signal input for each of the main artificial proprioceptors; 

means for obtaining a first and a second derivative signal for each data signal; 

means for obtaining a thinil derivative signal for at least one of the data signals; 

a set of first state machines, the first state machines being used to select one state 
20 among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

means for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; and 
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a second state machine, the second state means being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events 
associated to the data signals. 

In accordance with a further aspect of the present invention, there is provided a 
5 control system for controlling an actuated prosthesis in real time, the system 
comprising: 

a plurality of main artificial proprioceptors; 

means for obtaining a first and a second derivative signal for each data signal; 

means for obtaining a third derivative signal for at least one of the data signals; 

10 a set of first state machines, tine first state machines being used to select one state 
among a plurality of possible states for each main artificial proprioceptor with the 
corresponding data and derivative signals; 

means for generating the phase of locomotion portion using the states of the main 
artificial proprioceptors; 

15 a second state machine, the second state machine being used to select the portion of 
locomotion among a plurality of possible portions of locomotion using events 
associated to data signals; 

means for calculating a locomotion speed value; 

means for storing a lookup table comprising coefficient values with reference to at 
20 least phases of locomotion, portions of locomotion and locomotion speed values; 

means for determining actual coefficient values from the looKup table using at least 
the phase of locomotion portion, the portion of locomotion and the locomotion speed 
value; 

means for calculating at I ast one dynamic parameter value of the actuated 
25 prosthesis using the coefficient values from the lookup table; and 
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means for converting the dynamic parameter value into an output signal to control th 
actuated prosthesis. 

These and other aspects of the present invention are described in or apparent from 
the following detailed description, which description is made in conjunction with the 
5 accompanying figures. 

BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 is a blocK diagram showing the control system In accordance with a preferred 
embodiment of the present invention. 

FIG. 2 is a perspective view of an example of an actuated prosthesis with a front 
1 0 actuator configuration. 

FIG. 3 is a perspective view of an example of an actuated prosthesis with a r ar 
actuator configuration. 

FIG. 4 Is an upper schematic view of an insole provided with plantar pressure 
sensors. 

1 5 FIG. 5 is a cross sectional view of a sensor shown in FIG. 4. 

FIG. 6 is an example of a state machine diagram for the selection of the portion of 
locomotion, 

FIG. 7 is an example of the phases of locomotion portion within one portion of 
locomotion (BTW) in the state machine diagram shown in FIG. 6. 

20 FIGS. 8a to 8d are examples of four data signals using plantar pressure sensors 
during typical walking on flat ground. 

FIGS. 9a to 9d give an example of a data signal obtained from a plantar pressure 
sensor at the calcaneus region and its first three differentials. 

FIGS. 10a to I0d give an example of a data signal obtained from a plantar pressure 
25 sensor at the metatarsophalangeal (MP) region and its first three differentials- 
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FIGS. 11a to 11d give an example of the states of a plantar pressure sensor with 
reference to the data signal and its three first difTerentiation for a plantar pressure 
sensor at the calcaneous region. 

FIGS, 12a to I2d give an example of the states of a plantar pressure sensor with 
5 reference to the data signal and its three first differentiation for a plantar pressure 
sensor at the metatarsophalangeal (MP)region. 

FIG. 13 is an example of a state machine diagram for the selection of the state of the 
plantar pressure sensors for the calcaneous region. 

FIG, 14 is an example of a state machine diagram for the selection of the state of the 
1 0 plantar pressure sensor$ at the metatarsophalangeal (MP) region. 

FIG. 15 is an overall t>lock diagram of the Phase Recognition Module (PRM). 

FIG. 16 is a blocK diagram showing the zero callpration. 

FIG. 17 is a block diagram showing the subject's weight calibration. 

FIG. 18 is a block diagram of the Trajectory Generator (TG). 

15 FIG. 19 is a block diagram showing the creation of the Trajectory Generator (TG) 
lookup table. 

FIG. 20 is a graph showing an example of curve representing a kinematic or kinetic 
variable for a given portion of locomotion, phase of locomotion portion and subject's 
speed. 

20 FIG- 21 is an enlarged representation of FIG. 20. 

ACRONYMS 

The detailed description and figures refer to the following technical acronyms: 
A/D Analog/Digital 

BDW •'Downward Inclined Walking - Beginning path" portion of locomotion 
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BGD "Going Down Stairs - Beginning path" portion of locomotion 

BGU "Going Up Stairs - Beginning path portion of locomotion 

BTW "Linear Walking - Beginning path" portion of locomotion 
BTW_SWING Detection of typical walKing grjeg during leg swing 

5 BUW "Upward Indined Walking - Beginning path" portion of locomotion 

CDW "Downward inclined Walking - Cyclical path" portion of locomotion 

CGD "Going Down Stairs - Cyclical path" portion of locomotion 

QGU "Going up Stairs - Cyclical path" portion of locomotion 
CTW "Linear WalKing - Cyclical path" portion of locomotion 

10 CUW "Upward Inclined Walking - Cyclical path" portion of locomotion 

ECW "Curve Walking Path" portion of locomotfon 

EDW "Downward inclined WalKing - Ending path" portion of locomotion 

EGD "Going Down Stairs - Ending path" portion of locomotion 

EGU "Going Up Stairs - Ending path" portion of locomotion 

15 ETW "Linear Walking - Ending path" portion of locomotion 

EUW "Upward Inclined WalKing - Ending path" portion of locomotion 

FR_BINx Detection of a positive ^ 



FRfet_BINx Detection of positive first differentiation of f„ 

FRsec_BlN« Detection of positive second differentiation of f^^ 

20 FRtrd_BIN, Detection of positive third differentiation of 

FR_HIGH, Detection of f„ level above the STA envelope 

FR_LOWx Detection of {f». level between the zero envelope and the STA envelope 

FSR Force Sensing Resistor 

GR_POSy Detection of a positive gry 

25 MIN_SIT Detection of a minimum time in portion SIT 



06-20-03 14:51 



OE-McCARTHY TETRAULT s.r.l/LLP 



514-397-2014 



T-002 P. 16/98 F-150 



9 

MP Metatarsophalangeal 

RID Proportional'IntegFal-DKferential 

PKA_SDW Sit down knee angle 

PKA_ETW End walking knee angle 

5 PKA_STA Stance Knee angle 

PKA_SIT Sit down knee angle 

PKA_SUP_RAMP Standing up knee angle 

PPMV Plantar Pressure Maximal Variation 

PPS Plantar Pressure Sensor 

10 PRM Phase Recognition Module 

REG Regulator 

RF Radio Frequency 

SDW "Sitting down" portion of locomotion 

SIT "Sitting" portion of locomotion 

1 5 STA "Stance of feet" portion of locomotion 

STA_BIN Detection of a static evolution of ail £x 

STATlC_GRy Detection of g,y level below the zero angular speed envelope and 
the zero acceleration envelope 

suma Localized plantar pressure signal of left foot 

20 sumb Localized plantar pressure signal of right foot 

sumc Localized plantar pressure signal of botti calcaneus 

sumd Localized plantar pressure signal of both MP 

sume Localized plantar pressure signal of both feet 

SUM_BI Ny Non-Zero of sumy 

25 SUP "Standing Up" portton of locomotion 
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SVD Singular Values Decomposition 

SWINGy Detection of a sowing prior to a foot strike 

TG Trajectory Generator 

XHUSB Heel Loading State Bottom (X = Left (L) or Right (R)) 

5 XMLSM Heel Loading State Middle (X - Left (L) or Right (R)) 

XHLST Heel Loading State Top (X = Left (L) or Right (R)) 

XHSTA Heel STAtic state (X - Left (L) or Right (R)) 

XHUSB Heel Unloading State Bottom (X = Left (L) or Right (R)) 

XHUST Heel Unloading State Top (X = Left (L) or Right (R)) 

1 0 XHZVS Heel Zero Value State (X = Left (L) or Right (R)) 

XMLSM MP Loading State Middle (X = Left (L) or Right (R)) 

XMLST MP Loading State Top (X =» Left (L) or Right (R)) 

XMSTA MP STAtic state (X = Left (L) or Right (R)) 

XMUSB MP Unloading State Bottom (X = Left (L) or Right (R)) 

15 XMUST MP Unloading State Top (X = Left (L) or Right (R)) 

XMZVS MP Zero Value State (X = Left (L) or Right (R)) 

ZV^FRfstk Threshold to consider the first differentiation of ^ to be positive. 
ZV_FRsecx Threshold to consider ttie second differentiation of to be positive. 

ZV_FRtrdx Threshold to consider the third differentiation of fn^ to be positive. 

20 ZV_FRx Threshold to consider f^^ to be positive 

ZV__SUMfst Threshold to consider the absolute value of the 1^ diff. of sumy to be 
positive. 

ZV_SUMsec Threshold to consider the absolute value of the 2^^ diff. of simiy to be 
positive 
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DETAILED DESCRIPTION 

The appended figures show a control system (10) in accordance with the preferr d 
emtX3diment of the present invention- It should be understood that the present 
invention is not limited to the illustrated implementation since various changes and 
5 modifications may be effected herein without departing from the scope of the 
appended claims. 

FIG. 1 shows the control system (10) being combined with an autt}nomous actuated 
prosthesis for amputees. It is particularly well adapted for use with an actuated leg 
prostiiesis for above-Knee amputees, such as the prostheses (12) shown in FIGS. 2 
and 3. Unlike conventional prostheses, these autonomous actuated prostheses (12) 
are designed to supply the mechanical energy necessary to move them by 
themselves. The purpose of the control system (10) is to provide the required signals 
allowing to control an actuator (14). To do so, the control system (10) is interfaced 
with the amputee using artificial proprioceptors (16) to ensure proper coordination 
between the amputee and the movements of the actuated prosthesis (12). The set of 
artificial proprioceptors (16) captures Information, in real time, about the dynamics of 
the amputee's movement and provide that information to the control system (10). The 
control system (10) is then used to determine the joint trajectories and the required 
force or torque that must be applied by the actuator (14) in order to provide 
coordinated movements. 

FIG. 2 shows an example of an actuated leg prostiiesis (12) for an above-Knee 
amputee. This prosthesis (12) is powered by a linear actuator (14). The actuator (14) 
moves a Knee memt)er (20) with reference to a trans-tibial member (22), both of 
which are pivotaliy connected using a first pivot axis. More sophisticated models may 
25 be equipped with a more complex pivot or more tnan one pivot at that level. 

An artificial foot (24) Is provided under a bottom end of the trans-tibial member (22). 
The Knee member (20) comprises a connector (25) to which a socKet (26) can b 
attached. The socK t (26) is used to hold the sump of the amputee. The design of 
the Knee m mber (20) is such that the actuator (14) has an upper end connected to 
30 another pivot on th knee member (20). The bottom end of the actuator (14) is then 
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connected to a third pivot at the r>ottom end of the trans-tibial m mber (22). In use, 
the actuator (14) is operated by activating an electrical motor therein. This rotat s, in 
one direction or another, a screw (28). The screw (28) Is then moved in or out with 
reference to a follower (30), thereby changing the relative angular position between 
5 the two movable parts, namely the knee member (20) and the trans-tibial member 
(22). 

FIG. 3 shows an actuated leg prosthesis (i2) in accordance to a rear actuator 
configuration. This embodiment is essentially simitar to that of FIG. 2 and is 
illustrated with a different model of actuator (14). 

10 It should be noted that the present invention is not limited to the mechanical 
configurations illustrated in FlQS. 2 and 3. The control system (10) may be used with 
a leg prosthesis having more than one joint For instance, it can be used with a 
prosthesis having an ankle joint, a metatarsophalangeal joint or a hip joint in addition 
to a knee joint. Moreover, Instead of a conventional socket a osseo-integrated 

15 devices could also be used, ensuring a direct attachment between the mechanical 
component of the prosthesis and the amputee skeleton. Other kinds of prostheses 
may be used as well 

Referring back to FIG. 1, the information provided by the artifiaal proprioceptors (16) 
are used by the control system (10) to generate an output sIgnaL These output 

20 signals are preferably sent to the actuator (14) via a power drive (32) which is itself 
connected to a power supply (34), for instance a battery, in order to create Uie 
movement The power drive (32) is used to control the amount of power being 
provided to the actuator (14). Since the actuator (14) usually includes an electrical 
motor, the power drive (32) generally supplies electrical power to the aauator (14) to 

25 create the movement. 

Preferably, feedback signals are received from sensors (36) provided on the 
prosthesis (12). In the case of an actuated leg prosthesis (12) such as the one 
Illustrated in FIGS. 2 and 3, these feedback signals may indicate the relative position 
m asured between two movable parts and the torque betwe n them. This option 
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allows the cxsntroi system (10) to adaquataly adjust the output signal Other types of 
physical parameters may be monitored as well. 

The control system (10) shown in FIG, 1 comprises an interface (40) through which 
data signals coming from the artificial proprioceptors (16) are received. They may he 
received either from an appropriate wiring or from a wireless transmission. In the 
case of actuated leg prostheses for appve-Knee amputees, data signals from the 
artificial proprioceptors (16) provided on a healthy leg are advantageously sent 
through the wireless transmission using an appropriate RF module. For example, a 
simple off-the-shelf RF module with a dedicated specific frequency, such as 916 MHz, 
may be used. For a more robust implementation though, the use of a RF module with 
a spread spectrum or frequency hopper Is preferable. Of course^ other configurations 
may be used as well, such as a separate A/D converter, different resolution or 
sampling values and various combinations of communication linK technologies such 
as wired, wireless, optical, etc. 

The control system (10) further comprises a part called Thase Recognition Module" 
or PRM (42), The PRM (42) is a very important part of the control system (10) since it 
is used to determine two important parameters, namely the portion of locomotion and 
the phase of locomotion portion. These parameters are explained later in the text. 
The PRM (42) is connected to a Trajectory Generator, or TG (44), from which 
dynamic parameters required to control the actuated prosthesis (12) are calculated to 
create the output signal. A lookup table (46) is stored in a memory connected to the 
TG (44). Moreover, the control system (10) comprises a regulator (48) at which the 
feedback signals are received and the output signal can be adjusted. 

Software residing on an electronic circuit board contains all the above mentioned 
25 algorithms enabling the control system (10) to provide the required signals allowing to 
conUol the actuator (14)- More specifically, the software contains the following three 
modules: the Phase Recognition Module (PRM), the Trajectories Generator (TG) and 
th Regulator (REG). Of course, any number of auxiliary modules may be added. 

The artificial proprioceptors (16) preferably comprise main artificial proprioceptors and 
30 auxiliary artificial proprioceptors. The main artificial proprioceptors ar preferably 
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localized plantar pressure sensors wnich measure the vertical plantar pressure of a 
specific underfoot area, while the auxiliary artificial proprioceptors are preferably a 
pair of gyroscopes which measure the angular speed of body segments of the lower 
extremities and a Kinematic sensor which measures the angle of the prosthesis Knee 

5 joint The plantar pressure sensors are used under both feet, Including the artificial 
foot. It could also be used under two artificial feet if required. One of the gyroscope 
is located at the shanK of the normal leg while the other is located on the upper 
portion of the prosthesis above the Knee joint. As for the Kinematic sensor, it is 
located at the prosthesis Knee joint. Other examples of artificial proprioceptors (16) 

10 are neuro-sensors which measure the action potential of motor nerves, myoelectrical 
electrodes which measure the internal or the external myoelectrical activity of 
muscles, needle matrix implants which measure the cerebral activity of specific region 
of the cerebrum cortex such as motor cortex or any other region indirectly related to 
the somatic mobility of limbs or any internal or external Kinematic and/or Kinetic 

15 sensors which measure the position and the torque at any joints of the actuated 
prosthesis. Of course, depending on the application, additional types of sensors 
which provide information about various dynamics of human movement may be used. 

FIG- 4 shows a right insole (50) provided with two plantar pressure sensors (16) 
positioned at strategic locations. Their size and position were defined in accordance 
20 with the stability and the richness (intensity) of the localized plantar pressure signals 
provided by certain underfoot areas during locomotion. Experimentation provided 
numerous data concerning the spatial distribution of foot pressures and more 
specifically on the Plantar Pressure Maximal Variation (PPIV1V) during locomotion. 
The PPMV, denoted ^msoL^ri^ . was defined as the maximum variation of the plantar 

25 pressure at a particular point (underfoot area of coordinate i j) during locomotion. The 
X-Y axis (52) in FIG, 4 was used to determine the i j coordinates of each underfoot 
area. 

A PPMV of a given underfoot area of coordinates i,j during a given step denoted 
event x, is defined as stable, through a set of N walking steps, if the ratio of the 
30 absolute diff rence between this PPMV and the average PPMV over the set is inferior 
to a certain value representing the criteria of stability, thus: 
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^ f I -AtQ 



u«0 



N 



Equation 1 



• 100%^(S%) 



where &.^f,J is the PPMV localized at underfoot 



area of coordinates /, / during the event x. thus 

• A,»^L=/r(4^..-/.T(*)U„. fortheeventx 
- K is the number of sannples (frames), 

• N is the number of steps in the set, 



S is the chosen criteria to define if a given 
PPMV is stable. 



A PPMV of a given underfoot area of coordinates i,j during a given step denoted 
event x, is defined as rich in information, through a set of N walking steps, if the ratio 
between the PPMV and the average PPMV of the set is superior to certain value 
representing the criteria of richness, thus: 



n»0 



N 



Equation 2 



max*'' 



^^f^ Am«frM.L '® ^ PPMV localized at underfoot 
area of coordinates i. j during the event x, thus 
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• K is the number of samples (frames), 

* N is the number of steps in the set, 

R is the chosen criteria to define if a given 

■ 

PPMV IS rich In infomiation. 

It was found by experimentation that the size and the position of plantar pressure 
sensor are well defined when the criteria are set at 5 % and 50 % for the stability and 
the richness PPMV respectively. As a result, it was found that the calcaneus and the 
Metatarsophalangeal (MP) regions are two regions of the foot sole where the PPMV 
5 may be considered as providing a signal that is both stable and rich in information. 

in FiG.4, the plantar pressure sensors (16) are provided in a custom-made Insole 
(50), preferably in the form of a standard orthopedic insole, that is modified to embed 
the two sensors (16) for the measurement of two localized plantar pressures. Each 
sensor (16), as shown in FIG. 5, is preferably composed of a thin Force-Sensing 

10 Resistor (FSR) polymer cell (54) directly connected to the interface (40) or indirectly 
using an intermediary system (not shown), for instance a wireless emitter. 
Mechanical adapters may be used if FSR cells of appropriate size are not available. 
The FSR cell (54) has a decreasing electrical resistance in response to an increasing 
force applied perpendicularly to the surface thereof. Each cell (54) outputs a time 

15 variable electrical signal for which the intensity is proportional to the total vertical 
plantar pressure over its surface area. 

The normalized position of the pressure sensors and their size are shown in Table 1 , 
where the length L and the width W are respectively the length and the width of the 
subject's foot. The coefTicients in Table 1 have been obtained by experimentation, A 
20 typical diameter for the plantar pressure sensors (i 6) is between 20 and 30 mm. 
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Tabto 1 • Normalized positi n and size of pr ssure s n ore 



Area 


Position (X, Y) Size (diameter) 


Calcaneus 


{0.51W.0.14 L) 0.29 Vl W 


MP 


<0.47 W, 0.76 L) 0.24 • Vl • W 



In use, the PRM (42) ensures, in real-time, the recognition of the phase of locomotion 
portion and the portion of locomotion of an individual based on the information 
provided by the artificial proprioceptors (16). The PRM (42) is said to operate in real 
5 time, which means that the computations and other steps are performed continuously 
and with almost no delay. 

In accordance with the present invention, it was found that data signals received from 
individual artificial proprioceptors (16) can provide enough information in order to 
control the actuator (14) of an actuated prosthesis (12). For instance, in the cas of 

10 plantar pressure sensors, it has been noticed experimentally that the slope (first 
derivative), the sign of the concavity (second derivative) and the slope of concavity 
(third derivative) of the data signals received from plantar pressure sensors, and of 
combinations of those signals, give highly accurate and stable information on the 
human locomotion. The PRM (42) Is then used to decompose of the human 

1 5 locomotion into three levels, namely the states of each artificial proprioceptor (16), the 
phase of locomotion portion and the portion of locomotion. This breakdown ensures 
the proper identification of the complete mobility dynamics of flie lower extremities in 
order to model the human locomotion. 

The actual states of each main artificial proprioceptor depict the first level of the 
20 locomotion breakdown. This level is defined as the evolution of the main artificial 
proprioceptors' sensors during the mobilrty of the lower extremities. Each sensor has 
its respective state identified from the combination of its data signal and its first three 
differential signals. For the main artificial proprioceptors of the preferred embodiment, 
which provid information about localized plantar pressures, rt has been discovered 
25 xperimentally that the localized plantar pressures signals located at the calcaneous 
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10 



and at the metatarsophalangeal (MP) regions may be grouped into seven and six 
states respectively. 

For the sensors at the calcaneous regions, the states are preferably as follows: 

XHUSB Heel Loading State Bottom (X = Left (L) or Right (R)) 

XHLSM Heel Loading State Middle (X - Left (L) or Right (R)) 

XHLST Heel Loading State Top (X = Left (L) or Right (R)) 

XHSTA Heel STAtic State (X = Left (L) or Right (R)) 

XHUSB Heel Unloading Stale Bottom (X » Left (L) or Right (R)) 

XHUST Heel Unloading State Top (X = Left (L) or Right (R)) 

XHZVS Heel Zero Value State (X Left (L) or Right (R)) 

For the sensors at the MP regions, the states are preferably as follows: 
XMLSB MP Loading State Bottom (X = Left (L) or FUght (R)) 
MP Loading State Top {X = Left (L) or Right (R)) 
MP STAtic State (X = Left (L) or Right (R)) 
MP Unloading State Bottom (X = Left (L) or Right (R)) 
MP Unloading State Top (X = Left (L) or Right (R)) 
MP Zero Value State (X = Left (L) or Right (R)) 



XMLST 
XMSTA 
15 XMUSB 
XMUST 
XMZVS 



Identifying the states at each sensor allows to obtain the second level of the 
locomotion breakdown, referred to as the phase of locomotion portion. The phase of 

20 locomotion portion is defined as the progression of the subject's mobility within the 
third level of locomotion breakdown, namely the portion of locomotion. This third lev I 
of the locomotion breakdown defines the type of mobility the subject is currently in, 
such as, for example, standing, sitting or climbing up stairs. Each locomotion portion 
contains a set of sequential phases illustrating tne progression of the subject's 

25 mobility within that locomotion portion. The phas sequence mapping for each 
locomotion portion has been identified by experimentation according to tne evolution 
of the state of the localized plantar pr ssures throughout th portion. 
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The portions of locomotion are preferably as follows: 





BPW 


"Downward Inclined WalKing - Beginning path" 




BGD 


"Going Down Stairs - Beginning path" 




BGU 


"Going Up Stairs - Beginning path 


5 


BVN 


"Unear Walking - Beginning path" 




BUW 


"Upward Inclined WalKIng - Beginning path" 




CDW 


"Downward Inclined Walking - Cyclical path" 




CQD 


"Going Down Stairs - Cyclical path" 




CGU 


"Going Up stairs - Cyclical path " 


10 


CTW 


"Linear Walking - Cyclical path" 




CUW 


"Upward Inclined Walking - Cyclical path" 




ECW 


"Curve Walking Path" 




EDW 


"Downward Inclined Walking - Ending path" 




EGD 


"Going Down Stairs - Ending path" 


15 


EGU 


"Goina Uo Stairs — Endino oath" 




ETW 


"Linear Walking - Ending path* 




EUW 


"Upward Inclined Walking - Ending path" 




SDW 


"Sitting down" 




SIT 


"Sitting" 


20 


STA 


"Stance of feet" 




SUP 


"Standing Up" 



FIG. 6 ilfustrates an example of the state machine concerning these various portions 
of locomotion. 

FIG. 7 shows an example of a phase sequence mapping, BTW.1 to BTW_25, for the 
25 Beginning Path of Unear WalKing (BTW) portion of locomotion. AH locomotion 
portions have similar patterns of phase sequence mapping, though the number of 
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phases may vary from one locomotion portion to another The number of phases 
depends on the desired granularity of the decomposition of the locomotion portion. 
The phases are determined experimentally by observing the states of the four 
localized plantar pressures at specific time intervals, which are determined by the 
5 desired granularity. Since a phase is the combination of the states of the four 
localized plantar pressures, the phase boundary conditions are therefore defined as 
the combination of each localized plantar pressure state boundary conditions. 

For the selection of the portion of locomotion the subject is in, the algorithm uses the 
state machine approach. For this purpose, the algorithm uses a set of events which 
10 values define the conditions, or portion boundary conditions, to pass from one 
locomotion portion to another. These events are identified by experimentation 
according to the evolution of the localized plantar pressure signals, the 
complementary signals and their first three differentials, as well as the signals from 
the auxiliary artificial proprioceptors, when the subject passes from one locomotion 
5 portion to another. 

Having determined the states of the main artificial proprioceptors' sensors, the phase 
of locomotion portion and portion of locomotion of the subject, the TQ (44) can be 
used to calculate one or more dynamic parameter values to be converted to an output 
Signal for the control of the actuator. Examples of dynamic parameter values are the 

20 angular displacement and the torque (or moment of force) at the knee joint of the 
actuated leg prosthesis (12). Since these values are given in real time, they provide 
what is commonly referred to as the "system's trajectory". At any time k during the 
subject's locomotion, a mathematical relationship is selected according to the state of 
the whole system, that is the states of the main artificial proprioceptors, the phase of 

25 locomotion portion, the portion of locomotion and the walking speed. Following 
which, the angular displacement the moment of force are then computed 

using simple time dependant equations and static characteristics associated with the 
state of the system, thereby providing the joint's trajectory to the knee joint memb r. 
This process is repeated throughout the subjects locomotion. 

30 FIGS. 8a to 8d show examples of data signals from the four localized plantar pressure 
sensors (16) during a standard walking path at 109,5 steps/minute. The four signals. 
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fn(t), feft). fr3(t) and fr4(t), correspond to the variation in time of the localized plantar 
pressure at the calcaneus region of the left foot (FIG. Ba), the MP region of the left 
foot (FIG. 8b). the calcaneus region of the right foot (FIG. 8c). and the MP region of 
the right foot (FIG. 8d). 

5 In accordance with the present invention, the PRM (42) uses the first, the second and 
the third differentials of each of those four localized plantar pressure signals in order 
to determine the sensors' state. From there, the PRM (42) will De able to determine 
the phase of locomotion portion and portion of locomotion of the subject. 

FIGS, ga to 9d and 10a to I0d show examples of graphs of localized plantar 
10 pressures, as well as their first, second and third differentials, at the calcaneus and 
MP regions respectively, for a linear walking path of 109,5 steps/minute. 

FIGS. 11a to lid show graphically the state boundary conditions for a typical 
localized plantar pressure signal, and its first three differentials, at the calcaneous 
region, while FIGS. i2a to 124 do so for the localized plantar pressure signal, and its 
15 first two differentials, at the MP region. This shows the relationships between the 
various data and derivative signals, and the states. 

In use, for the detection of the state of the four localized plantar pressures, denoted fix 
where x = [1 , 4], the PRM (42) uses a set of first state machines to select, at each 
increment in time, the current state of each sensor. For this purpose, the algorithm 
20 uses a set of events who's values define the conditions to pass from one state to 
another for each of the localized plantar pressures. Table 2 lists the events: 

Table 2 - List of events used to evaluate the state boundary condition of a 

localized plantar pressure 



Event 


Acronym 


Description 


Non-Zero of fo, 


FR_BINx 


Detection of a positive f^^ 


First Differentiation of fjx 


FRfst^BlNx 


Det ction of positive first 
differentiation of 
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Second Differentiation of fa 


FRsec_BlNx 


Detection of p>ositive second 
differentiation of f„ 


Third Differentiation of 


FRtrd_BIN, 


Detection of positive third 
differentiation of ^ 


Static fni 


STA_B1N, 


Detection of a static evolution of all fn 



The conditions placed on the values of each of the depicted events of Table 2 define 
when the state machines pass from one state to another for each of the localized 
plantar pressures. Ta&le 3 lists the thresholds used to assess if the aforementioned 
conditions are mex, in which sum, depicts the five complementary signals, for y = [a, e] 



5 as described in Table 4. while Table 5 shows the mathematical form of the events 
used to evaluate the state boundary condition of the localized plantar pressures. 



Table 3 • List of thresholcte used to evaluate the state boundary condition of a 

localized plantar pressure 



Threshold 


Acronym 


Description 


Positive value of tn 




Threshold to consider ^ to be 
positive 


Positive value of af„^/at 


ZV^FRfst, 


Threshold to consider the first 
differentiation of to be positive. 


Positive value of S'f^/St' 


ZV_FRseCx 


Threshold to consider the second 
differentiation of ^ to be positive. 


Positive value of 


ZV_FRtrd* 


Threshold to consider the third 
differentiation of 5x to be positive. 


Position value of dsumy/dt 


Z\/_SUMfst 


Threshold to consider the absolute 
value of the first differentiation of suiny 
to be positive. 
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Positive value of dhmijdt' 




Threshold to consider the absolute 


ZV^SUMsec 


value of the second differentiation of 






siuHy to be positive 



Table 4 - List of eomplamentary signals built from the four localized plantar 

pressure fn, fn. fr3. r^, 



Signal 


Acronym 


Description 


Mathematical valu 


Left foot 


suma 


Localized plantar pressure signal 
of left foot 


(£i + f,2)/2 


Right foot 


sumb 


Localized plantar pressure signal 
of right foot 


(fr3l-^4)/2 


Both 

calcaneus 


sun^ 


Localized plantar pressure signal 
of both calcaneus 




Both MP 


sunrid 


Localized plantar pressure signal 
of both MP 


(frt + f.4)/2 


Both feet 


sume 


Localized plantar pressure signal 
of both feet 





Table 5 - Mathematical formulation of events 



Acronyno 


Mathematiciil form 


FR^BIN* 


\\ otherwise J 


FRfst^BINx 


[\ otherwise 
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FRsec_BINx 




0 ''^W.^,_«^J 

1 Otherwise 




FRtrd^BlN, 




I otherwise 




STA_BIN 




I 




•\ 

>ZV_SUMfst 

J 
i 


■1 






>• 







FIGS. 13 and 14 show, respectively, the diagrams of the state machines used for the 
detection of the state of the localized plantar pressure at the calcaneous and the MP 
regions, while Tables 6 and 7 summarize the state tioundary conditions between the 
Slates of each localized plantar pressure. 



5 Table 6 - List of state boundary conditions defining the states of tite main 

artificial proprioceptors at the calcaneus region 



Current 
State 


SiATe Boundary Conditions 


Next State 


Any state 


IFFLBINx 


XHZVS 


Any state 


FR_BlNx && STA_BINx 


XHSTA 


Any state 


FR^BIN,. && !STA_BINx && FRfst_BINx && 
FRsec_ BIN* && FRtfd_ BIN* 


XHUSB 


Any state 


FR_BINx && ISTA_BIN, && FRfsi_ BIN* && 
FRsec_BlNx && IFRtrd.BlN* 


XHLSM 


Any state 


FR_BINx && ISTA^BlNx && FRfst_BINx && 
IFRsec^BIN, 


XHLST 
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Any state 


FR^BlNx && ISTA.BIN, && !FRfst_BlNx && 
!FRsec_ BiNx 


XHUST 


Any state 


FR^BlNx && !STA_BfNx && !FRfst_BlNx && 
FRsec_BlN, 


XHUSB 


Table 7 - List of state boundary conditions defining the states of the main 
artificial proprioceptors at meuitarsophaiangeal region 


Current 
State 


State Boundary Conditions 


HwxT State 


Any state 


!FR_BINx 


XMZVS 


Any state 


FR_BINx && STA_BlNx 


XMSTA 


Any state 


FR_BINx && ISTA_BINx && FRfist_BINx && 
FRsec^ BiNx 


XMLSB 


Any state 


FR_BlNx && ISTA^BINx && FRfst_BiNx && 
!FRsec_BlNx 


XMUST 


Any state 


FR_BlNx && lSTA_BINx && !FRfst_BINx && 
!FRsec_ BINx 


XMUST 


Any state 


FR_BINx && JSTA^BINx && !FRfst_BINx && 
FRsec_ BlNx 


XMUSB 



FIG. 15 shows a flow chart that depicts the PRM algorithm, which comprises two main 
parts, namely the pre-processing of the main artificial proprioceptors signals and the 
5 locomotion breakdown, illustrated by blocks 100 and 102 respectively. The sequence 
of steps performed the pre-processing of the main artificial proprioceptors signals, 
repres nted by block 100, is indicated by the sequence of blocks 104 to 118. At block 
104, the four localized plantar pressures signals are received from the interface and 
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normaiized at block 106 using subject specific calibration values. The four normalized 
local plantar pressures then go through the pre-pn^cessing steps represented by 
blocKs 104 to 11 B. At blocK 112, the four normalized local plantar pressures are 
filtered to reduce their spectral composition. A counter is then initialized at block 108, 

5 which in turn starts a loop comprising blocks 1 10 to 1 1 6. The first step of the loop, at 
block 110, consist in the differentiation of the signals. The signals resulting from the 
differentiation step are filtered at block 1 12, in order to limit the noise induced during 
the differential computation, and go through binary formatting at block 114. At block 
1 16, the algorithm checks if the counter has reached 3 iterations. If so, the algorithm, 

10 having computed ail first three derivatives of the four normalized local plantar 
pressures signals, exits the loop to block 102. if not, the algorithm proceeds to block 
110 where the counter is increased at block 118 and the loop is repeated, in order to 
computed the next derivative, by proceeding to block 110, When the loop exists to 
block 102. the algorithm enters into the locomotion breakdown part of the algorithm. 

15 The sequence of steps performed by the locomotion breakdown, represented by 
block 102, is indicated by the sequence of blocks 120 to 124. From the four 
normalized local plantar pressures and their first three derivatives, block 120 
determines the states of each sensor while blocks 122 and 124 determine the phase 
and the portion of locomotion, respectively. 

20 The normalization step, represented by block 106, consists in levelling the magnitude 
of the raw data signals according to the anthropomorphic characteristics of the 
subject such as, in the preferred embodiment, the subjea's weight. The raw data 
signals of the four localized plantar pressures are divided by the total magnitude 
provided by the four sensors during calibration and then provided as the normalized 

25 local plantar pressures to block 110. 

At block 112 the normaiized raw signals of the four localized plantar pressures and 
their first three differentials are numerically filtered to reduce their spectral 
composition, as well 9S to limit the noise induced during the derivative computation. 
The pref rred embodiment of the PRM (42) uses a 2^^ order numerical filter in which 
30 the cut-off frequency, th damping factor and the fon^fard shifting have been set. 
experimentally, to optimiz the calculation according to the locomotion portion and th 
type of signal. The PRM (42) may use other types of numerical filters as well, for 
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example a '^Butterworth" filter, as long as the filter's dynamic is similar to the one 
provided by the 2^ order filter shown thereafter for each locomotion portion. 
Equation 4 shows the mathematical relationships of the 2^^ order numerical filter 
which is implemented within the PRM (42). Table 8 provides examples of filtering 
5 parameters for three different portions of locomotion. 

Laplace form 

^2 Equation 3 

H(s) = ^ Y 



^^^^^ , j0 in the none damping natural frequency, = . ^' . c,<^ 

* is called the resonance frequency for ^ < 1 

• C, is the damping factor 
Recursive forrn 



H(2)- M ^2 

a, y (k) = bjxCk - 1) + baxCk -2)- ajy(k - 1) - (k - 2) Equation 4 

where - 1 

a2 = "2'ap 
aa 

b,=0 



e = sin(G>rTJ 
K sampling rate 
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Table 8 - Examples of param t ra of 2*^ order filters used by the PRM 



Portion of locomotion 


Type of 
signal 


Filtering Parameters 


Cut-Off 
Frequency (Fc) 


Damping 
Factor (z) 


Forward 
Shifting 


Linear WalKing - 
Beginning path (BTW) 


Raw 


2 


0.680 


7 


Derivative 


3 


0.700 


3 


Linear Wa{|<ing - 
Cyclical path (CTW) 


IRaw 


2 


0.680 


7 




Derivative 


3 


0.700 


3 


Linear Wall<lng - 
Ending path (ETW) 




2 


0.680 


7 


Denvative 


3 


0.700 


3 



At block 110, the derivatives are obtained by the standard method consisting of 
numerically differentiating the current and the previous samples of localized plantar 
pressures. 



5 The derivatives obtained at block 1 10 then go through binary fonnatiing at block 114. 
The result of the binary formatting operation will be a '*r if the sign of the derivative is 
positive. "0" if it is negative. This step facilitates the identification of the sign chang s 
of the differentiated signals as binary events. 

At block 120, the PRM (42) detemiines the current state of each sensor using state 
10 machines such as the ones shown in FIGS, 13 and 14. 

In the PRM (42), the states of the localized plantar pressures are preferably 
expressed as a 10-bit words in which each bit corresponds to a specific possible 



15:00 DE-McCARTHY TEmULT s.. ,/LLP 514.397-29,4 1-002 P.3e/99 FH50 



29 

state. Tables 9 to 12 list the binary equivalents of each state of the localized plantar 
pressures at the calcaneous and the MP regions of the left and the right foot. Of 
course, words of dHTerent bit length may be used as well to represent the state of 
each localized plantar pressure, 

5 Table 9 « Numerical labels of the states for the localized plantar pressure at 

calcaneous area of the left foot 



State 


Binary Label 


Decimal 
Label 


UHSBS 


OOOQQOOOOO 1 


0 


LHLSB 


0000000001 0 


1 


LHLSM 


00000000 100 


2 


LHLST 


0000000 1 000 


3 


LHUST 


000000 10000 


4 


LHUSM 


00000 100000 


5 


UHUSB 


00001 000000 


6 


UHZVS 


000 10000000 


7 


LHSTA 


00100000000 


8 
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Table 10 -Numerical iaiaels of th atates for the localiz d plantar pr sure at 
metatarsophalangeal area of the left foot 



State 


Binary Label 


Decimal 
Labeu 


LMSBS 


0000000000 1 


0 


LMLSB 


000000000 1 0 


1 


LMLSM 


OOOOOOOO 100 


2 


1 kill ex 


UUUUUuUl uuu 


o 

o 


UMUST 


00000010000 


4 


LMUSM 


000001 00000 


5 


LMUSB 


00001000000 


6 


LM2VS 


00010000000 


7 


LHSTA 


001 OOOOOOOO 


8 
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Table 1 1 - Numerical labels of the stat s for th localized plantar preseure at 

calcaneous area of the right foot 



State 


Binary Label 


Decimal 

LABEL 


KnSBS 


QUOOuDUOOU 1 


0 


Qui o & 


0000000001 0 


1 


RHLSM 


00000000100 


2 




vlwUUUwU lUUU 


o 
O 


RHUS! 


000000 10000 


4 


RHUSM 


00000 1 00000 


5 


RHUSB 


00001 000000 


6 


RHZVS 


000 10000000 


7 


RHSTA 


00100000000 


8 
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Table 12 ^Numerical lab Isofth stat s forth localized plantar pressure at 
metatarsophalangeal area of the right foot 



STATE 


Binary Label 


Decimal 

UABEL 


RMSBS 


00000000001 


0 


RMLSB 


00000000010 


1 


RMLSM 


00000000 1 00 


2 


RMLST 


00000001000 


3 


RMUST 


00000010000 


4 


RMUSM 


00000 100000 


5 


RMUSB 


00001000000 


6 


RMZVS 


00010000000 


7 


RHSTA 


00100000000 


8 



AT block 122, the PRM (42) generates the phase, which is preferably expressed as 
the direct binary combination of the states of the four localized plantar pressures. 

5 Accordingly, the phase can be represented by a 40-bit word wherein the lower part of 
the lower half word, the higher part of the lower half word, the lower part of the higher 
half word and the higher part of the higher half word correspond, respectively, to the 
calcaneous area of the left foot, the MP area of the left foot, the calcaneous area of 
the right foot and the MP area of the right foot, as represented In Tables 9 to 12. 

10 Table 13 presents an example of the identification of a phase from the states of the 
four localized plantar pressures. 
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Table 13 - Identification of a phase from the states of the main artificial 

proprioceptors 



State of Localizad Plantar Pressure 


Corresponding Phase 


Rignt Foot 


Left Foot 


MP area 


Caicaneous 


MP area 


Calcaneous 


0000000100 


0000010000 


0000000001 


0000010000 


OO0OQ001 00000001 0000 
0000000001 00000 1 0000 



At blocK 124, the PRM (42) selects the portion of locomotion the subject Is currently 
5 using the state rnachine shown in FIG. 6. Each portion of locomotion is composed of 
a sequence of phases. 

Accordingly, Table 14 presents the phases sequence mapping for the Beginning Path 
of Linear Walking (BTW) locomotion portion corresponding to FIG. 7. This table 
shows the label, the decimal value and as well the phase boundary conditions of each 
10 phase. 

Table 14 - Example of phases sequence mapping for the locomotion portion 
labeled ''Beginning Path of Linear Walking" (BTW) 



Phase 


Phase Boundary 
Conditions 


Label 


Value 


Fn 








BTW_1 


275146604800 


8 


8 


8 


8 


BTW_2 


34493964416 


6 


7 


3 


7 


BTW_3 


2281717888 


1 


7 


4 


7 




4429217920 


2 


7 


5 


7 


BTW_5 


17213489280 


4 


5 


6 


7 


BTW_6 


17314119808 


4 


7 


5 


7 


BTW_7 


34493988992 


5 


7 


5 


7 
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B7W_8 


34494087296 


5 


7 


7 


7 




34361868416 


5 


1 


5 


7 


BTW_10 


34361966720 


5 


1 


7 


7 


B7W_11 


68723802240 


6 


2 


7 


7 


BTW_12 


68727996544 


6 


3 


7 


7 


BTW_13 


68727867520 


6 


3 


1 


7 


BTW_14 


137455732864 


7 


4 


1 


7 


BTW_15 


137455734912 


7 


4 


2 


7 


BTW_16 


137455739008 


7 


4 


3 


7 


BTW_17 


137472512128 


7 


5 


2 


7 


B7W_18 


137472516224 


7 


5 


3 


7 


BTW_19 


137472524416 


7 


5 


4 


7 


BTW_20 


137573187712 


7 


7 


4 


7 


BTW_21 


137573204096 


7 


7 


5 


7 


BTW_22 


137573187586 


7 


7 


4 


1 


BTW_23 


137573203970 


7 


7 


5 


1 


BTW_24 


137573236740 


7 


7 


6 


2 


BTW_25 


137573236744 


7 


7 


6 


3 



Table 15 enumerates a sample of boundary conditions associated with the locomotion 
portion of the sitting and typical walking on flat ground movements, while Table 3 lists 
the thresholds used to assess if the aforementioned conditions are met. 
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Table 15 - Example of a list of portion boundary conditions defining specific 

locomotion portions such as sitting movements (STA-SUP-SIT-SDW-STA 
locomotion portion) and typical waking on flat ground (STA-BTW-^TW-ETW- 
5 STA locomotion portion) 



Current 
portion 


Sat of Evfints 


Next 
Portton 




oWflNvaieg 






•STATlC^GRtefl II 






ISTATlC_GRprost 






FR_LOWprDs»_rieei 


BTW 


STA 


FR_BIN»aLi«« 
BTW_SWiNG 






FR_HIGHiea_neei 






FR_HIGHp»osu»ei 


SOW 




PKA_SDW 




BTW 


STATlC_GR,«a 
STATIC^GRpros, 


ETW 


SUM.BINpreet 
SWINGp,^ 


CTW 


CTW 


STATIC_GR,Ba 
STATlC_GRp,oat 


STA 
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Current 
Portion 


Set of Events 


N xt 
Portion 




rrC_DHNpfOBt_neei 

FR_BINie8jieei 

PKA_ETW 

STATlC_GR,efl II STATlC_GRp,ost 


ETW 


ETW 


PKA_STA 


STA 


SDW 


PKA^SIT 


SIT 


PKA^STA 


STA 


SIT 


GR.POSae 
MIN_SIT 

FR_HIGH|egL<np 

FR HIGHixDst mo 


SUP 


PKA_STA 


STA 


SUP 


!SUM_BINprost 

ISUM_BIN|e9 


SIT 


PKA_STA 


STA 


!PKA_SUP_RAMP 


SIT 
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Ta|3l 16 - ExampI of a list of v^nts used to evaluate th port! n boundary 
conditions defining specific locomotion portions such as sitting movem nts 
(STA-SUP-SIT'SDW-STA locomotion portion) and typical walcing on flat gr und 
(STA-BTW-CTW-ETW-STA locomotion portion) 



Event 


Acromyn 


Description 


Swing occurence 


SWINGy 


Detection of a swing prior to a foot strike 


Non-Zero of fot 


FR_BlNx 


Detection of a positive fm 


Lowfm 




Detection of level between the zero 
envelope and the STA envekipe 


Highf„ 


FR^HIGHx 


Detection of fp, level above the STA 
envelope 


Static 


STATlC_GRy 


Detection of gry level below the zero 
angular speed envelope and the zero 
acceleration envelope 


Non-Zero of sumy 


SUM_BINy 


Detection of a positive sum. 


BTW swing 
occurrence 


BTW_SWING 


Detection of tvoical walkino Or laa durino 
leg swing 


Positive gry 


GR_POSy 


Detection of a positive Qry 


Minimum sitting 


MIN^SIT 


Detection of a minimum time in portion 
SIT 


Sit down Knee 
angle 


PKA_SDW 


Detection of knee angle higher than the 
STA envelope 


End walking knee 
angle 


PKA_ETW 


Detection of knee angle lower than th 
STA nvelope 
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Evont 


AcFomyn 


Description 


Stance Knee angle 


PKA_STA 


Detection of Knee angle K>wer than the 
STA envelope 


Sit down Knee 
angle 


PKA_SIT 


Detection of Knee angle higher than the 
SIT envelope 


Standing up Knee 
angle 


PKA_SUP_RA 
MP 


Detection of standing up Knee angle 
evolution 



v^ere ■ X stands for leg_heei. Ie0_mp. pro&thetic_heel or prosthetic_mp 
• Y stands for leg or prosthesis 

The normalization step of blocK 106 uses specific calibration values. These values 
are computed the first time a subject uses the actuated prosthesis (12) or at any other 
time as may be required. Two calibration values are preferably used: the zero 
5 calibration value and the subject's weight calibration value. The zero calibration value 
consists in the measurement of the four localized plantar pressures when no pressure 
is applied to the sensors, while the subject's weight calibration value is the subject's 
weight relative to the magnitude of the total response of the sensors. 

The algorithm to obtain the zero calibration value of the sensors is depicted by the 
10 flow chart shown In FIG. 16. The sequence of steps composing the algorithm is 
indicated by the sequence of biocKs 200 to 222. In blocK 200, the algorithm starts with 
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proce ding to biocK 208. At block 220. the average of each iocaliz d plantar 
pressures is computed and finally provided as the zero calibration value at block 222. 

In a similar fashion, the algorithm to obtain the subject's weight calibration value Is 
depicted by the flow chart shown in FIG. 17. The sequence of steps composing th 
5 algorithm is indicated by the sequence of blocks 300 to 322. In bksck 300, the 
algorithm starts with the four localized plantar pressures. At block 302, the subject 
stands up in a comfortable position, feet at shoulder width distance, while maintaining 
the body in the stance position. Then, at block 304, the subject slowly swings back 
and forth and then left to right, which initialises a timer at block 306. which In turn 

10 starts a loop comprising blocks 308, 310 and 312. At btock 308. the algorithm ch cks 
if the timer has reached 10 seconds, if so, then the algorithm exists the loop to block 
320, if not, the algorithm proceeds to block 310 and records the subject's weight 
relative to the magnitude of the total response of the sensors. Then, at block 312, th 
timer is increased and the loop is repeated by proceeding to block 308. At bk)ck 320, 

15 the average of each localized plantar pressures is computed and finally provkJed as 
the weight calibration value at block 322. 

FIG. 18 shows a flow chart that depicts the TG algorithm used to establish a 
relationship, in real-time, between the output of the PRM (42) and localized plantar 
pressures and the knee joint trajectory. The sequence of steps composing the 

20 algorithm is indicated by the sequence of blocks 400 to 408. At block 400, th 
algorithm receives the normalized localized plantar pressures, the phas of 
locomotion portion and the portion of the locomotion from the PRM (42). Then, at 
block 402. the walking speed of the subject, in steps per minute, is obtained from 
computing the number of frames between two heel strikes, while taking into account 

25 the sampling frequency, and is binary formatted. More specifically, the subj ct's 
speed estimate x, [k] (steps/minute) is obtained from computing the number of 
frames between two heel strikes s^^, I kj (frames/step): 

jc * 60 ~ Equations 
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where )\ is the frame sampling frequency (frames/second). 
A heel strike event occurs when: 

tmresholomeeluoaojng < /, ,^ [t] - f,^^ \k-\\, 1/ = 1, 3 Equation 6 

At block 404, the algorithm uses the normalized localized plantar pressures, the 
phase of locomotion portion, the portion of the locomotion and the subject's spe d in 
binary format to identify a set of linear normalized static characteristics linking the 

5 knee joint kinetic/kinematic parameters with the subject's locomotion in a lookup 
table. At block 406 the TG (44) comprises two transformation functions which 
compute the kinetic/kinematic parameters at time k, which are the angular 
displacement 6j^(k) and the moment of force (torque) mkn(k), using the localized 
plantar pressures and their corresponding mathematical relationships (tim - 

10 dependant equations and static characteristics) identified at block 404. The values of 
the kinetic/kinematic variables are then provided to the REG (48) at block 408. 

The transfonmation functions used by the TG (44) at block 406 may generally be 
represented by a system of equations such as: 

e,., (k) = Q, (d, (k), x(k), v(k)) (»2 (k), x(k), v(k)) + . , . -h Equation 7 

fiq^i (Sq-. XCk)> v(k)) ^ Ci^ (\ (k), x(k), v(k)) 

wi,.^ (k) = M , (», (k), x(k)» v(k)) + M 3 (»j (k), x(k), v(k)) Equation 8 

M (S^>| (k), x(k), v(k)) + M , (S, (k). x(k). v(k)) 

where • g = [sagittal (sg), frontal (fr). transversal (tr)l is the plane of the motion 

• h - [hip (hp), knee (kn), ankle (an), metatarsophalangeal (mp)l is the joint 

• q is the number of the main artificial proprioceptors' sensors 

• Sqis th phenomenological entity related to th locomotion and provided 
by the mam artificial proprioceptors' sensors 
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- Q^is the transformation function between the phenom nological entity 

related to the locomotion, the kinematic variables of the lower extremities 
and the time 

- M^is the transfonmation ^inction between the phenomenological entity 

related to the locomotion, the kinetic variables of the lower extremities 
and the time 

- is the phenomenological entity related to the locomotion and provided 
by the main artificial proprioceptors' sensors 

• x(k) = fl(Ph(k),Pr(k),v{k)) is the state of the whole system (amputee and 
the AAP) in which K is the current increment 

' p,)(lc) is the phase of the respective locomotion portion 
p,{k) is the locomotion portion 

* v(]c) is the walking speed 

- k is the current increment 

In the case where the TG (44) uses polynomial relationships of order n, Equation 7 
and Equation 8 become: 

e9;.(k) = a,,(x(K).v(k))'»,(k)-h,.. + a,„(x(k),v(k)) »,(kr+ Equations 

a,,(x(k).v(k)) S2(k)^^^--^a,„(x(k),v{k)) &2(Kr -^- + 

aqH.;(x(k).v(k))-Vi<k) + ..'^a,.,,(x(k),v(k)).Vi(^^^ 
a,,(x(K),v{k)) »,(k)-h...-^a,.,(x(k),vCk)) ^,(kr 
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•"an(k) = i>,.(x(k).v(k))-d,(K)+...+b,„(x(K).v(k)).3.(k)"f Equatl n 10 

, (x(k). v(k)) ■ a, (k) + ... + b,^(x(k).v(k)) • d.Ck)" . . . + 
^-u(x(k).v(k)) V(k)-h... + b,_,„(x(k),v(k)) S,.,(kr -^...-.■ 
^a(x(k).v(k))-»,(k)^-.,.-.b,„(x(k),v{k))■»,(kr 

where a,,(x{k)) and b,,(x{k)) i-Wq are the coefficients for the state x(k) of 
the whole system and the walking speed v(k) and n is the order of the 
polynomial 

The preferred embodiment uses four localized plantar pressures, thus Equation 9 and 
Equation 10 become: 

ea.n(k) = a,j(x(k).v(k))t.(k)-^...+a.^(x(k).v(K))f„(k)" + Equation 11 

a2,(x(k).v{k)) f,3(k)+... + a,„(x(k).v(k)).t,(k)'' 
a,,(x(K).v(k)) f,,(k)-i-...+a,^(x(lc).v(K)) f„(kr + 

a, ,(x(k).v(k))f,,(k)-f...i-a,„(x(k).v(k))-f,,(k)" 

«««^(l^) = t>u(x(K).v(k)) f„(k)+...-hb,„(x(k).v(k)) .f,(kr ^ Equation 12 

b„(X(K).v(k)) • f,,(k) + ... + b,„(x(k). v(k))- t,(k)" -^ 

b, a (x(k). v(k)) . f„(k)+ ... +b3„(x(k). v(k)) . f„ (k)" + 
b.,(x{k). v(k)) •f,3(k)+ ... + b,^{x(k).v(k)) • f,3(kr 

where ay{x(k)) and b„(x{k)) i=Wq are the coefficients for the state x(k) of 
the whole system and the walking speed v(k) and n is the order of the 
polynomial 



Since all the kinetic/kinematic parameters B^,(k) and mtmCk) are computed from non 
complex mathematical relationships, the computatton of the trajectory is simple and 
5 fast and can be calculated by a non-sophisticated electronic circuit board. 

The mathematical relationships (time-dep ndant equations and static characteristk^s) 
used in th s~ non compi x mathematical relationships are contained in a k)okup table 
referenced at block 404. FIG. 19 shows a ftow chart that depwts th algorithm used 
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to create the TG looKup table. The sequence of steps composing the algorithm is 
indicated by the sequence of blocks 500 to 512. At block 500, the algorithm 
measures the selected phenomeiogical parameters, which in the pref nred 
embodiment are the localized plantar pressures, and the kinetc/kinematic parameters 

5 flfcnC*^) niKn(k) of a subject. The measured phenomeiogical parameters are then 
normalized in function of the subject's weight. At block 504, the static characteristics 
linking the phenomeiogical parameters to the kinetc/kinematic parameters and the 
time<lependant equations linking to the time are identified ano are then normalized at 
block 506. Then at block 508, the mathematical relationships (time-dependant 

10 equations and static diaraaeristics) are broken down according to the 
phenomeiogical parameters, the phases of locomotion portion, portions of locomotion, 
the speed of the subject and in the case were Equation 1 1 and Equation 12 are linear 
functions, the binary formatted data signals. For each set of mathematical 
relationships (time-dependant equations and static characteristics) created by th 

15 breakdown, a polynomial regression is applied, at block 510, to the mathematical 
relationships (time-dependant equations and static characteristics) contained In the 
set. Finally, at block 512, the results of the polynomial regressions are stored in the 
lookup table and are indexed according to the breakdown of block 508. 

The method for building this TG lookup table depicted by the flow chart of FIG. ig 
20 may be applied to any equations belonging to the following analytical/logical family of 
functions: 
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Hi 

1 



j-i i-o Equation 13 

where • ^ i$ the estimated kinematic ( 6^.^ ) or kinetic ( m^^ ) variables for the g 
lower extremities joint through the h plan of motion 

' g is the lower extremities joint among the following set: hip, knee, ankle 
and metatarsophalangeal 

- h is the plan of motion among the following set: sagittal, frontal and 
transversal 

- ^ is the loconnotion related phenomenon, for example the localized 
plantar pressure 

• a^., is the l"^ coefficient associated the locomotion related phenomenon 
denoted x, 

• Uj is the order of the polynomial depicting the j"^ locomotion related 
phenomenon denoted x, 

• xis the number of locomotion related ph nomena 
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If it is considered that the family of functions in Equation 13 are dependant on th 
state of the systen) they depict, thus following system of equations is obtained: 

y8.u-l;i;a,,(x).x; 

j=i Equation 14 

where x is the time dependant state vector of the system 

In the preferred embodiment, may be substituted by the localized plantar pressures 
denoted f^^ , where if = [1. xl- In the case of time-dependant equations, may be 

substituted by the time. Thus, in the case of plantar pressures. Equation 14 
becomes: 

•r=i Equation 15 

where x is the time dependant state vector of the system 

Previously, yQ.n has been defined as the estimated kinematic (6^^^) or kinetic (liigh) 
variable for the g lower extremities joints through the h plan of motion. Thus, 
Equation 15 may be written as: 



*>*'i-o Equation 16 

or 

Equation 17 

10 The goal is the identification of the Equation 16 and Equation 17 functions from a set 
of n, samples, obtained from experimentation. A sample contains data related to the 
locomotion related phenomenon along with the corresponding kinematic (e^ J or 
kinetic (mg,h) variables. 

The following array of data is obtained from experimentation: 
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TabI 16 - Data obtain d from xperini ntation 





f 


x> 


Y 


Y 

2 










6 


fti u 


1 






















2 












































is 



































































Where ■ j , x is the index and the number of locomotion related phenomena 

- ;^ , is the index and the number of frames 

- / is the time [s] 

• X is the time dependant state vector of the system 
" Xj is the selected locomotion related phenomenon 

• e^ j, is the Kinematic variables for the g lower extremities joint through 
the h plan of motion 

• m^ ^ is the Kinetic variable for the g lower extremities joint through the h 
plan of motion 

The logical functions aj^{x) are then present d in th form of a looK-up iaWe» as 
shown In the following example: 
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Tabl 17 - Uook-up table exampi 





t 


X 






• 
















1 


Xt 


34.5 


23.1 




12.3 


92.5 




83.6 


52.4 




72.5 


2 


X2 


23.6 


87.5 




64,4 


84,9 




93.4 


38,6 




28.5 


























ic 


X,c 


76.9 


82.5 




93,3 






37,5 


82.3 




84,4 


























nc 




61.4 


90.6 




72.3 


26.4 




83.5 


26.4 




28,6 



/c, Oc index and dimension of the look-up table (nc is the number of 

where - 

considered quantized states) 

< X i8 the time dependant state vector of the system 

Table 17 establishes the relationship between the time dependent state vector of the 
system, the locomotion related phenomenon and the kinematic and the kinetic 
5 variables of the lower extremities joints, whfch are the following static charactenstics: 

Equation 18 

*tf.h = f ""C*'^) Equation 19 

The methodology used to identify th parameters aj^(x) is based on th application 

of a curve-fitting algorithm to a set of data provided from experimentation on human 
subjects. This experimentation is p rformed in a laboratory environm nt under 
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controlled conditions, yielding a s t of data in the form of an airay, as shown in Table 
16. 

The curve-fitting algorithm is used to obtain the parameters a^;(x) for every given 

time dependant state vector x . This data is used to construct the look-up table, as 
5 shown in Table 17. 

An example of configuration for the method previously described is presented below: 

1 . the particularities of this configuration are: 

a. the locomotion related phenomenon is composed of a set of four 
localized plantar pressures supplied by the mam artificial proprioceptors; 

10 b. the time dependant state vector is composed of: 

i. the walking speed of the subject; 

ii. the phase of locomotion portion and the portion of locomotion; 
and if Equation 16 and Equation 17 are linear functions: 

iii. the binary fomiatted magnitude of the four localized plantar 
1 5 pressures; 

2. the family of functions depicting the static characteristics e^^ = f^(x,x) and 

=f'*(x,x) , as described In Equation 16 and Equation 17; 

or 

the family of functions depirting the time-dependant equations 0^^ = f^(x,t) 
20 and m^ ^ = /""(x,?), as described in Equation 16 and Equation 17 when is 

substituted by time t. 

3. the selected lower extremities joints is the knee joint, which is the joint beiwe n 
the thigh (th) and the shanK (sh), 

4. the selected plan of motion is the sagittal plan; 

25 In the case where Equation 16 and Equation 17 are linear functions, th time 
dep ndant state vector further comprises the binary formatted magnitude of the four 
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localized plantar pr ssures as added parameters to further segm nt the curv 
representing the kinematic (6^ ,,) or Kinetic (mg^) variables. This is due to the fact 

that, as shown by FtG. 20, that for a given portion of locomotion, phase of locomotion 
portion and subject's speed, the curve representing the kinematic (6^ ,,) or kin tic 

5 (mH,)i) variables cannot efHciently be approximated by a linear function. To that end. 
the binary formatted plantar pressures are used to further subdivide the phase of 
locomotion portion in a number of intervals on which the curve representing the 
kinematic (9g^) or kinetic (mg^h) variables may be approximated by linear functions. 

FIG. 21 is a dose-up view of FIG. 20 where it is shown that the curve representing the 
10 Kinematic (9^^) or kinetic (m^^,) variables appear relatively linear on each of the 

added subdivisions. Thus, the use of Equation 16 and Equation 17 which are linear 
functions entails that the time dependant stated vector will further comprise the binary 
formatted plantar pressures. 

It should be noted that in the preferred embodiment, the lookup table contains 
15 mathematical relationships that have been normalized in amplitude. The TO (44) 
uses the relative value of the localized plantar pressures instead of the magnitude of 
the signal. This means that the localized plantar pressures are set into a (0, 1] seal 
for a specific state of the whole system xO^) - This ensures that the mathematical 
relationships (time-dependant equations and static characteristics) are independent of 
20 the weight of the subject. It is worth to note that, because the TG's architecture use 
the walking speed as a component of the state of the whole system, the static 
characteristics lookup table is valid for any walking speed comprised within th 
operational conditions, which are, in the preferred embodiment, between 84 and 126 
steps/min, though the lookup table may be computed for other intervals. 

25 The Regulator (48) uses a control law with a similar structure to control algorithms 
currentiy employed in numerous commercial or experimental applications. Various 
control laws may be implemented in the Regulator (48), examples of which are 
provided below. 

First, the Regulator (48) may us a simple PID control law. which is written as: 
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^4(t) -«ka x(t) ^ k^x(0 + Jxdt 



Equation 20 



where ' kd is the gain associated to the differential component of the regulator 

* kpis the gain associated to the proportional component of the regulator 

- k, is the gain associated to the integral component of the regulator 
' Xi is the requested trajeaory 

■ Xo is the trajectory performed t>y the system 

- X is the error between the requested (x,) and perfomied trajectory (Xo) 

* ^ is the set point intended to the system 

applied to the proposed system, that is x = G or x = m . we have: 



where • g = [sagittal (sg), frontal (fr), transversal (tr)J is the plan of the motion 

- h » {hip (hp), Knee (Kn), ankle (an), metataf^ophalangeal (mp)] is the joint 
• X = 8 or m 

where the transfer function between the error x and the set-point is expressed as: 



x,.„(t) z(z-l) 

where ■ b2 = k, + Kp + ko 

• bi=-(kp + Ko) 

• bo = ko 

• x=eorm 




Equation 21 



Equation 22 
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in which the corresponding recurrent equation is: 

Hfi\(k) = KmO^ - 1) bo ' X, - 2) -h • ,(k - 1) b3 • , (k) Equation 23 

where - k is the current increment 
• x-eorm 

Secondly, the Regulator (48) may use an adaptive PID control law. The transfer 
function of an adaptive PID is the same as that of a conventional PID but th 
parameters ba, bi and bo are function of the state of the whole system x(k) - From 
Equation 23, the recurrence equation of the adaptive PID is: 



(k) - (k - 1) + bo(x(k)) • X, , (k - 2) + 
b,(x(k)) X, ,(k --l) ^ b,(x(k)) x,,(k) 

where • k is the current increment 



Equation 24 



• X - 6 or m 

Thirdly, the Regulator (48) may use a conventional PID with measured moment, 
which may be written as: 

f;.h (k) = f^n (k) + f tk) Equation 25 

where - f ^^^^ (jc) is the force measured at the joint 

• f g,h (k) is the force generated by the regulator 

• f g% (k) is the set point of the force intended to the joint 

Form Equation 22. the transfer function between the position error x^, ^ and the force 
set-point f^ ^Ck) is expressed as: 
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Equation 26 



where • K is the gain yielded by the device between the position and the force set 
point 

• X = 6 or m 



Thus, the recurrent equaton of the final force set point f,";,. (k) is given by the following 
relationship: 



fl^ik) = f »(k) + f,j.(k - 1) + b„ • X^ Jk - 2) i- 
b.x6.«(k-l) + bj-x,^(k) 



Equati n27 



where ■ k is the current increment 
• x = 8orin 



